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RESULTS  ON  BIORTHONORMAL  FILTER  BANKS 

Igor  Djokovic,  student  member,  IEEE  and  P.  P.  Vaidyanathan.  Fellow.  IEEE 


Abstract.  For  a  maximally  decimated  nonuniform  filter  bank,  the  perfect  reconstruction 
(PR)  property  is  equivalent  to  biorthonormality.  We  start  from  this  result  and  derive  a  number  of 
properties  of  PR  filter  banks.  For  example,  no  two  integer  decimators  in  a  biorthonormal  system 
can  be  coprime;  moreover  if  all  analysis  and  synthesis  filters  have  unit  energy,  then  perfect  recon¬ 
struction  is  equivalent  to  orthonormality.  We  also  generalize  the  Nyquist  and  power  complementary 
properties  of  orthonormal  filter  banks,  for  the  biorthonormal  case.  We  then  show  that  whenever  the 
decimation  ratios  are  such  that  biorthonormality  is  possible  with  rational  filters,  it  is  in  particular 
possible  to  obtain  orthonormality  with  rational  filters.  This  is  done  by  developing  an  orthonormal¬ 
ization  procedure.  While  reminiscent  of  the  Gram-Schmidt  approach,  the  procedure  converges  in 
a  finite  number  of  steps  and  furthermore  preserves  the  filter-bank  like  form  of  the  basis  functions. 
We  then  modify  the  orthonormalization  procedure  for  the  application  of  subband  decorrelation. 
It  will  be  demonstrated  that  mere  decorrelation  of  subband  signals  does  not  necessarily  optimize 
the  coding  gain  of  a  system.  Finally  we  consider  the  problem  of  alias  cancellation,  and  obtain  a 
generalization  of  a  previously  known  necessary  condition  called  compatibility. 
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1.  INTRODUCTION 


Fig.  1(a)  shows  an  M  channel  filter  bank  with  integer  decimation  ratios  nk.  The  input  signal  jr(w) 

is  split  into  M  signals  which  are  passed  through  the  analysis  filters  //0(:).// iic) . II  \ f-i(~) 

and  decimated  by  n*  (integers)  for  k  =  0.1, . \I  -  1.  At  the  synthesis  end.  these  signals 

are  expandeded,  passed  through  synthesis  filters  /«(-).  F’i(-) . /•  a/ — i ( ~ )  and  added.  When 

x(n)  =  cx(n  —  no),  this  system  achieves  perfect  reconstruction  (PR).  In  this  paper  the  PR  property 
corresponds  only  to  i(n)  =  ar(n),  as  this  eliminates  some  inconvenient  notations  without  much  loss 
of  generality. 

When  Ylk  =  1>  we  have  a  maximally  decimated  filter  bank.  A  special  case  is  when 
nk  =  M  for  all  k.  Wre  call  it  the  uniform  filter  bank.  Every  nonuniform  maximally  decimated  filter 
bank  can  be  equivalently  represented  by  a  “larger”  uniform  '  Her  bank  as  in  Fig.  1(b)  (see  [lj.  [2 j 
and  [3]).  The  theory  of  uniform  filter  banks  is  well  developed  and  such  a  system  is  shown  in  Fig. 

2(a).  The  analysis  and  synthesis  fil  ers  can  be  expressed  in  polyphase  form  as 

,l/-l  A/-1 

Hi(z)=  Y,  and  F,(z)  =  £  !■  (1.1) 

*=0  k= 0 

With  each  filter  re.  sented  like  this,  the  system  can  be  drawn  as  in  Fig.  2(b)  where  E(c)  and 
R(  z )  are.  respectively,  the  polyphase  matrices  of  the  analysis  and  synthesis  banks.  This  system 
has  the  PR  property  x(n)  —  x(n )  if  and  only  if  R(z)  =  E"'(c).  There  are  different  ways  to  design 
a  uniform  filter  bank  that  achieves  PR.  so  the  existence  of  rational  filters  (i.o..  transfer  functions 
which  are  ratios  of  two  polynomials)  satisfying  the  PR  property  is  trivially  guaranteed.  But  in  the 
nonuniform  case,  it  is  not  always  possible  to  achieve  PR  with  rational  filters  [1]  (block  decimation 
[3]  is  not  considered  in  this  paper).  Notice,  however,  that  ideal  filters  (non  rational,  with  possibly 
complex  impulse  response)  can  always  be  found  such  that  the  PR  property  holds  for  any  set  {nk} 
satisfying  1  /nk  ~  1.  So,  whenever  we  discuss  existence  of  PR  systems,  the  discussion  pertains 
only  to  rational  filters. 

A  set  of  necessary  and  sufficient,  conditions  on  the  set  { ?* }  for  PR  to  be  possible  is  not  known. 
On  the  other  hand,  we  know  some  sufficient  conditions.  If  the  numbers  {n*}  are  coming  from  a 


tree  structure,  for  example,  then  we  can  have  PH  with  rational  filters  [4],  [5].  Not  all  decimation 
ratios  allowing  PR.  allow  it  with  a  tree  structure.  1 For  example  consider  XI  =  24  and  the  set 


{6.  10.  15.40 . 40}. 

' - - - - 

20  times 

This  set  satisfies  satisfies  5Z^.l0  1  /nk  =  1.  The  filters  that  achieve  PH  are  H,i~)  =  /,(;)  =  :~‘- 
where  the  set  of/.’sis  {0.  1.2.3.  1,5, 7.8.9. 10.  14,  14.15. 10. 10. 20. 22. 24.25. 20. 27. 2S. 29}.  l  or  this, 
note  that  the  output  of  the  i,h  decimator  is  x(m>i,  -l, ).  We  want  every  input  sample  to  go  through 
one  and  only  one  branch,  which  is  equivalent  to  saying  that  mu,  -  l,  f  kit,  -  Ij  for  /  ^  j  and 

any  choice  of  m  and  k.  On  the-  other  hand,  sina  gcdO-u-'M . "22!  =  1.  these  numb. 

come  from  a  tree  structure  (if  there  were  a  tree,  the  decimation  ratio  at  the  first  level  of  the  tree 
would  be  a  factor  of  this  gcd).  Because  of  such  possibilities,  we  will  not  assume  that  {nt  }’s  come 
from  a  tree.  Before  we  discuss  these  issues  in  greater  detail,  let  us  explain  some  conventions  and 
definitions  in  this  paper. 

All  our  signals  are  in  /o  space  (i.e..  the  space  of  finite  energy  sequences).  The  inner  product  is 
defined  as 

X 

<x(n).y(n)>~  x{n)yw(n).  (1.2) 

n  —  —  x 

and  the  norm  | |o:( 77 )| j2  will  be  defined  according  to  || ir( 77 )) j?  =<  x{v).x{n)  >  . 

Filter  bank-like  systems 


The  reconstructed  signal  x(n)  at  the  output  can  be  written  as 

A/  —  1  OC  OO 

x(n)  ~  Y  y  li,{ri,k  -  m)z{m)f,(ri  -  n,k) 

*  =  0  oc  m=-oc 

A/  —  1  00 

~  *«(*)/.(»  -  n,k). 

i  =  0  fc=  -  00 

where 

OC- 

Xi(k)  —  ^  hi[n,k  -  m)x(m)  (decimated  subband  signals). 

rn  —  — ■  oc 

t  The  authors  would  like  to  thank  Tsuhan  ('hen  for  pointing  out  this  example. 


(1.4) 


(1.1) 


Equation  (1.3)  is  an  expansion  of  J(7i)  in  terms  of  sequences  {/,(/)  -  n,k))*L  o'-  V/c  €  Z  (Z  is  the 
set  of  all  integers).  Here  ii(k)’ s  are  the  “filter  bank  transform  coefficients''  (i.e..  the  decimated 
subband  signals).  The  set  of  sequences 

Vik(n)  =  {/,(n  -  O-a) 

is  made  of  a  special  form  of  functions  namely  shifts  (by  integer  multiples  of  »,)  of  a  finite  number 
of  sequences.  We  refer  to  (1.5)  as  a  filter  bank-like  system.  The  set  of  sequences  /,(  ?'  -  n.k-)  will 
be  referred  to  as  the  n ^-shifted  versions  of  the  synthesis  filters  f,{n).  Later  on  it  will  be  shown  that 
this  system  is  a  Riesz  basis  for  C  space.  [This  is  subtle  because,  in  an  infinite-dimensional  Hilbert 
space,  completeness  and  independence  (see  Sec.  2.2.  for  the  definition)  of  a  set  of  vectors  is  not 
sufficient  to  conclude  that  these  vectors  form  a  Riesz  or  unconditional  basis:  see  Corollary  I.  Sec. 
2.2.] 

Birothonormality 

Definition  1.1.  A  system  of  sequences  {/i,(n-  mn, ).  fi(n  -  kni)}.  0  <  i.l  <  M  -  I  for  ali  m.k  €  2 
is  called  a  biorthonormal  system  if 

<  hi(n  -  mnj),  fi{-n  +  kn\)  >=  6{i  -  l)6(k  -  m)  (biorthonormality).  ( 1.6) 

In  the  special  case  of  orthonormal  filter  banks,  the  perfect  reconstruction  property  is  achieved  by 
setting  /it(n)  =  h*k(-n).  In  this  case,  the  biorthonormality  reduces  to 

<  hfin  —  mni),hi(n  -  kni)  >=  S(i  -  l)f>(k  -  m)  (orthonormality).  ( 1.7) 

If  the  above  equation  holds  for  some  i  and  /,  we  often  say  that  “the  two  filters  //,(r)  and  ///(') 
are  orthonormaT’.  It  should  be  borne  in  mind  that  the  acutal  meaning  depends  on  n,  and  rq. 
It  will  be  shown  that  perfect  reconstruction  (PR)  in  a  maximally  decimated  filter  banks  implies 
biorthonormality,  f  In  Section  2.1.,  we  will  show  that  the  most  general  form  of  PR  for  a  maximally 
t  This  is  a  fairly  subtle  fact,  holding  only  because  of  maximal  decimation.  For  example,  consider 
a  two-channel  undecimated  system  with  filters  //0( c )  -  1  +  r_1,  H i(;)  =  1  -  ~_1,  f'o(c)  =  /'i(c)  = 
1/2.  Then  we  have  PR.  but  it,  can  readily  be  verified  that,  biorthonormality  is  not  satisfied. 


decimated  filter  bank  is  a  biorthonormal  basis  for  />  space,  formed  by  the  analysis  and  synthesis 
filters.  This  issue  has  come  up  in  earlier  work,  but  has  not  been  shown  or  proved  this  way.  The 
relation  between  filter  banks  and  wavelets,  and  the  role  ot  orthonormality  lias  been  discussed  in 
[6],  [7],  [8],  [9]  and  [4]. 

From  this  result  we  can  obtain  useful  conclusions.  For  example  we  will  conclude  that  there 
must  be  no  coprime  pairs  in  the  set  of  decimation  ratios  or(^>r  f°r  FH  to  be  possible 

with  rational  filters  (ideal  perfect  reconstruction  filters  can  always  be  defined  for  any  maximally 
decimated  filter  bank).  Thus,  the  existence  of  rational  filters  achieving  PR  is  a  nontrivial  question 
in  the  nonuniform  case.  By  contrast,  in  the  uniform  filter  bank  theory,  we  can  design  analysis  filters 
and  just  invert  the  polyphase  matrix  E(;)  (as  long  as  its  determinant  is  not  identically  zero)  in 
order  to  obtain  PR  (with  possibly  unstable  or  noncausal  synthesis  filters). 

Orthonormality 

A  second  question  of  interest  in  nonuniform  filter  bank  theory  is  the  following;  suppose  the 
integers  are  suc*’  that  a  biorthonormal  PR  system  (with  biorthonormal,  rational  filters) 

exists.  Does  it  mean  that  an  orthonormal  PR  system  also  exists?  (Again,  for  the  uniform  case, 
the  existence  is  trivially  guaranteed  simply  by  constraining  E(s)  to  be  paraunitary.)  We  will 
show'  bv  construction  that  for  a  given  set  of  integer  decimation  ratios  { n ^ 1 .  the  existence  of 
biorthonormal  systems  implies  the  existence  of  o.thonormal  PR  systems  as  well  (Sec.  :5.). 

The  procedure  to  convert  the  biorthonormal  system  to  an  orthonormal  one  is  reminiscent  of  the 
Gram-Schmidt  (GS)  procedure,  but  is  not  the  same,  for  a  variety  of  reasons.  First,  the  orthonor¬ 
malization  of  the  basis  is  required  to  preserve  the  filter  bank-like  form  of  the  basis;  conventional 
GS  procedure  would  not  give  us  this.  Furthermore,  using  r-domain  analysis  and  the  special  form  of 
our  system,  we  will  be  able  to  do  the  orthonorma.lization  process  in  a  finite  number  ejf  steps  (even 
though  1 2  is  an  infinite  dimensional  space).  This  is  another  point  of  departure  from  the  traditional 
GS  technique. 

At  this  point,,  the  reader  should  be  warned  that  this  orthonormalizatiou  procedure  is  mostly 


■4 


of  theoretical  importance.  The  filters  resulting  from  the  orthonormalization  not  only  are  HR  in 
general,  but  also  have  huge  orders;  the  proposed  orthonormalization  is  not  an  alternative  design 
technique  for  filter  banks  (after  all  we  do  not  have  biorthonormal  filters  to  start  the  orthonormaliza¬ 
tion  with).  For  the  purpose  of  subband  coding,  there  exists  a  simple  scheme  to  generate  inexpensive 
orthonormal  filter  banks,  based  on  the  so-called  power  symmetric  filters  (pp.  20-4  [10]).  These  can 
also  be  used  in  a  tree  structure  to  obtain  a  subclass  of  nonuniform  HR  orthonormal  systems. 

1.1.  Paper  outline 

In  Sec.  2.  we  discuss  the  detailed  reasons  why  biorthonormality  and  perfect  reconstruction 
(PR)  are  identical  concepts  for  maximally  decimated  filter  banks*.  Several  corollaries  of  this  result 
aie  derived  in  Sec.  2.2.  For  example,  we  show  that  for  PR  to  be  possible,  no  two  decimation  ratios 
can  be  relatively  prime.  We  also  show  that  if  a  perfect  reconstruction  system  is  such  that  all  the 
analysis  and  synthesis  filters  have  unit  energy,  then  the  system  becomes  orthonarrnal  (paraunitary 
in  the  uniform  case). 

In  Sec.  3.  we  show  that  whenever  the  decimation  ratios  {rt,}  of  a  maximally  decimated  system 
are  such  that  perfect  reconstruction  is  possible  (i.e,.  such  that,  there  exist  biorthononnal  filters), 
then  in  particular,  there  exists  an  orthonormal  filter  bank.  The  proof  is  constructive,  that  is.  given 
a  set  of  biorthonormai  filters  we  show  how  to  find  a  set  of  orthonormal  filters  starting  from  these. 
Numerical  examples  are  included.  In  general,  the  resulting  orthonormal  filters  turn  out  to  be  HR 
even  if  we  start  with  an  FIR  biorthonormai  system.  However,  the  HR  filters  are  guaranteed  to 
be  free  from  poles  on  the  unit  circle.  This  means  that,  should  they  turn  out  to  he  unstable,  a 
noncausal  implementation  can  be  found  which  is  stable  [12],  [13], 

The  orthogonalization  technique  will  then  be  used  in  Sec.  4.  for  a  different  purpose,  namely 
decorrelation  of  subband  signals  of  a  uniform  filter  bank.  In  other  words,  referring  to  Fig.  2(a), 
imagine  that  we  are  given  a  wide  sense  stationary  input  signal  x{n).  We  will  show  how  to  find  the 
analysis  filters  {Hk(z)}  such  that  the  decimated  subband  signals  :r*(7j)  and  x,(m)  are  uncorrelated 

t  A  brief  sketch  of  some  of  the  results  has  been  presented  in  [11] 

r 

*') 


for  all  n,  rn  (for  k  -f  i).  While  this  might  appear  to  he  similar  to  the  Karhuneii-Loeve  transform 
(KLT)  [14],  there  is  a  fundamental  difference.  Namely,  the  KIT  decorrelates  arid  x,(m >  only 

for  n  —  m.  It  is  of  course  true  that  we  can  decorrelate  Sk(n)  and  x,(m)  for  all  it.  rn  trivially  by  use 
of  ideal  non  overlapping  filters.  But  we  will  construct  finite  order  (rational)  filters,  tuned  to  the 
statistics  of  the  WSS  input  x(n)  with  the  power  spectrum  STT(~)  which  is  assumed  to  he  a  rational 
function. 

As  a  consequence  of  the  analysis  in  Sec.  4..  we  learn  that  if  a  uniform  filter  hank  is  orthonormal 
[paraunitarv  E(r)],  then  the  subband  signals  cannot  be  decorrelated  in  this  way.  unless  the  power 
spectrum  Srx(eJW)  of  i(n)  has  the  form  F(pJ"'Af )  (i.e.,  has  a  period  of  2 ~/M  rather  than  2x). 
Whether  this  is  a  disadvantage  of  orthonormal  systems  is  arguable  because,  decorrelation  of  the 
subband  signals  does  not  necessarily  maximize  the  coding  gain  of  the  system,  again  unlikr  in 
transform  coding!  We  will  demonstrate  this  with  an  example.  This  section  is  restricted  to  the 
uniform  case,  mainly  because  of  a  technical  difficulty:  even  though  the  subband  signals  of  a  filter 
bank  are  WSS  for  WSS  input  x(n),  they  are  in  general  not  jointly  wide  sense  stationary  in  the 
nonuniform  case;  many  of  the  standard  second  order  statistical  tools  cannot  then  be  applied. 

In  Sec.  5.  we  derive  some  further  necessary  conditions  on  the  decimation  ratios  {»*.}.  for 
perfect  reconstructibility.  These  can  be  regarded  as  generalizations  of  the  compatibility  condition 
given  in  [1]  and  [p.  28o  of  10].  Some  of  the  technical  details  which  arise  in  the  proofs  have  been 
moved  to  the  Appendices  (A-C)  to  provide  a  smoother  reading. 

1.2.  Notations  and  conventions 

1.  The  quantities  A7  and  stand  for  transposition  and  transpose  conjugation  of  the  matrix 
A.  The  notation  H(c)  =  H^(I/r*).  Thus  Hfr)  =  H'(')  on  the  unit  circle. 

2.  Z  represents  the  set  of  all  integers  0.±1,±2 - 

3.  Special  integers.  The  integer  M  denotes  the  number  of  channels  of  the  nonuniform  system 

(Fig.  1(a)).  The  integer  L  =  1cm  (no, n\ - n,\/-t ).  Also,  gtJ  =  ged  {n,,n})  throughout  the 


(i 


paper.  The  integers  { k ,}  are  numbers  that  satisfy 


L  —  ko n0  =  kitii  =  —  k . 


(I.*) 


4.  Wl  =  e  The  subscript  L  is  omitted  whenever  it  is  clear  from  the  context.  W  is  the 

Lx  L  DFT  matrix.  It  has  elements  [W]mn  =  H’f".  Note  that  WfW  =  /.I. 

5.  The  AC  (alias-component)  matrix  for  analysis  filters  {defined  for  uniform  /.-channel  filter 
banks)  is  the  one  with  components  [H(  ;)],„«  =  Hn(z\Vm).  For  the  synthesis  filters  we  define 
a  similar  matrix:  [F(^)]mn  = 

6.  A  delay  chain  is  represented  by  e{?)  =  [  1  c-!  ...  2~'f+1  ]r  (see.  e.g..  Fig. 2(b)). 

7.  The  T/-fold  decimator  has  input-output  relation  y(n)  =  x(  M  v ).  or  in  the  r-domain 


V(~) 


_1_ 

M 


At  —  I 


£  Aru,/Vvr;f). 


(1.9) 


The  Af-fold  expander  has  the  input-output  relation 

,  f  x(nJM).  n  =  mul.  of  .' 
y(n)  =  1  0  otherwise. 


M 


(UOa) 


or  in  the  z- domain 


i’U)  =  X{zM). 


(1.106) 


The  notations  J and  \m  are  used  to  denote  these  operations.  Thus  n(n) j  denotes  the 
decimated  version  and  .4(c)|  w  ‘he  corresponding  ~-transforu<  that  is  e-transform 

°f  a(n)J,M. 

8.  For  uniform  filter  banks,  E(  ~)  and  R(j)  are  the  polyphase  matrices  of  the  analysis  and  synthesis 
filter  banks  (Fig.  2(b)). 

9.  Perfect  reconstruction  (PR)  means  x(n)  =  x(n).  In  the  uniform  case  it  is  equivalent  to 
R(z)E(;r)  =  I  (see  Fig.  2(b)). 

10.  The  so-called  noble  identity  for  multirate  systems  [10]  can  be  stated,  for  our  purpose,  as  follows 


A(zm')B(z) 


^  m L  m2 


(l.H) 


i 


2.  EQUIVALENCE  OF  BIORTHOGONALITY  AND  PR  PROPERTY 


For  the  study  and  design  of  uniform  filter  banks,  there  exist  powerful  tools  such  as  the  polyphase 
formulation  and  the  AC  matrix  formulation.  In  order  to  use  them  in  a  noiiuniform  filter  bank,  we 
have  to  transform  it  into  the  equivalent  uniform  one  [1],  [2].  This  is  shown  in  Tig.  Kb).  There  are 
L  branches  (where  L  is  the  1cm  of  {«,}),  and  each  of  them  has  the  same  decimation  ratio.  The 
analysis  filters  are  numbered  as 

S0(z),Sl(z) . Sk V*0(r) .  C2.1  i 

and  similarly  for  the  synthesis  filters  Q,{z).  Thus  the  analysis  and  synthesis  filters  are 

Si(z)  =  zpn‘  II i(:).  Qk(~)  =  12.2) 


where 

l—  1  m  —  1 

i  =  p  +  kj.  0  <  P  <  ki  -  1,  A-  =  r  +  kj,  0  <  r  <  kru  -  1.  «  2.)i  i 

j=o  j=o 

Here  k:  =  Ljn}  and  its  meaning  is  clear;  we  just  made  k,  delayed  filters  from  each  original  filter 
i.e.  each  new  filter  comes  from  one  of  M  original  filters.  The  biorthonormality  (  l.ti)  means 

^ hj(n  -  mnj)fi(-n  +  kni)  =  6(i  -  l)6(m  -  A~),  0<n/<  V/-l.  mJ>  5.  (2.4) 

n 

Eqn.  (2.4)  can  also  be  rewritten  as  [4] 


y:  hi(n)filmgn  —  n)  —  f(i  -  l)6(m).  0  <  ij  <  \l  —  1,  m  €  Z  (biorthonormality).  (2.5) 

n 

w'here  g,i  =gcd(n,,nj).  This  infinite  set  of  conditions  can  be  compactly  written  as  a  finite  set  of 
conditions  in  the  c- domain 


or  equivalently  as 

=  b{i  -  I )  (orthonormalit)  ).  ( 2>  > 

<1,1 

A  filter  bank  with  analysis  .id  synthesis  filters  satisfying  these  biorthonormal  \  ort  honormal )  eon 
ditions  will  be  called  a  biorthonormal  (orthonormal)  filter  bank.  We  sometimes  say  that  two  filters 
//,(~)  and  F,yz)  are  biort honormal  if  they  satisfy  (2.0).  ft  should  be  noticed  that  the  biort honor- 
mali:  e  definition  involves  n,  and  ru¬ 
in  this  section,  we  will  show  that  the  most  general  form  of  PH  lor  a  maximally  decimated  fillet 
bank  is  a  biorthonormal  basis  for  T  space,  formed  by  the  analysis  and  synthesis  filters,  i  his  issue 
has  come  up  in  earlier  work,  but  has  not  been  shown  or  proved  this  way.  Ihi-  will  1m*  followed  by 
the  derivation  of  a  number  of  corollaries. 

2.1.  PR  Implies  Biorthogonality  of  Analysis  and  Synthesis  Filters 

Theorem  2.1.  Let  the  system  in  Fig.  1(a)  be  a  maximally  docimaied  filter  bank  with  decima 
tion  ratios  If  the  filter  bank  has  the  perfect  reconstruction  property,  the  filters  form  a 

biorthonormal  system,  that  is  satisfy  (2.6). 

Remarks. 

1.  This  is  a  fairly  subtle  fact,  holding  only  because  of  maximal  decimation,  l  or  example,  consider 
a  two-channel  undecimated  system  with  filters  //0(  - )  -  1  +  -~1.  // 1  ( ~ )  =  1  -  ;-1.  /•<)(-)  -- 
f\ (~)  =  1/2.  Then  wo  have  PR.  but  not  biort hotiorntality. 

2.  The  converse  of  the  above  theorem  also  holds;  see  Appendix  B  of  [15]. 

Proof.  Let  S,(z)  and  Ch-U)  be  analysis  and  synthesis  filters  of  the  eqivaient  uniform  filter  bank. 
They  are  related  to  //(U)  and  Fm(z)  by  (see  Fig.  1(b)) 

•S',( -')  =  z”n‘  //,(-),  Qk(z)  =  :-rn" /„,(  O.  (2.P) 

where 

i-i  ni  - 1 

?  =  />  +  ^  kj.  0  <  p  <  k'i  -  1,  k  =  r  +  ^  kj'  *'  <  r  <  k,„  -  1. 

J  =  0  7=‘> 


(f,(z)Fi[  :)) 


(2.101 


Let  S (z)  denote  the  AC  matrix  of  the  above  analysis  bank  .S’,(c).  that  is  [Si  r)]m„  =  )  (Sec. 

1.2.)  and  let  E( r )  be  the  corresponding  polyphase  matrix.  These  are  related  as  [10.  pp.  231] 

S(r)  =  WfA(  :)E7  (=L).  (2.11i 

where  A(r)  =  diag(l.r-1 . r~(/-_1)).  Similarly  for  the  synthesis  bank  define  Q( .: )  such  that 

[Q{  z  )]mn  =  <2„(cH  i.  and  let  R(  c )  be  the  polyphase  matrix  as  defined  in  S<>c.  1.  W<>  have 

Q (  r )  —  WA“ ! I  c  )R(  :L  ).  (2.12! 

Then 

=  i 

/ . ——*»•—  ■  "v 

S(~)Qr(r)  =  WfA(r)  (Ru'-fEl.  A_1(.')W  =  wHv  =  /.I.  (2.13 i 

This  is  because  R(c)E(r)  =  I.  due  to  PR  property.  So  we  get  [since  Sir)  and  Qir)  are  square 
matrices] 

Q(r)S'fr)  =  Si:  )QV  |  r)  =  Li.  (2.1  h 

Notice  that  without  the  assumption  of  maximal  decimation,  the  matrix  Air)  would  not  be  square. 
A-I(~)  would  not  exist  and  wo  would  not  have  S/(r)Q(r)  =  Q(:)SI  [:)  -  /,I  (which  is  an 
important  step  in  *he  proof!). 

The  condition  S7 (r)Q(r)  =  LI  implies,  in  view  of  the  definitions  of  Sir).  Q(r)  and  f  1.0).  that 

(S.U'K^.fr))  -  fi(i-fc).  (2. to) 

Now  suppose  that  i , k  are  such  that  l  jt  m  in  (2.3).  i.e.  that  S,(')  and  Qk(~)  do  not  come  from  the 
same  original  branch.  Then  (2.15)  ran  be  written  as 

=  0.  (2.16) 
L 

for  0  <  p  <  ki  -  I  and  0  <  r  <  k,„  -  1 .  With 

»(  -  a»d  (2.171 


^pni  ~  rr»m 


//if 
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where  g/m  =gcd(w/,Hm).  this  becomes 


^  Apt>i  -rb.ni  )3i  ...  //|(.:)/m(-)j  j  =  o. 


(2.1  Hi 


By  multiplying  (2.18)  by  zd ,  we  get 


?dl  I  y(Pb  fm  "  r  bm  [if, 


>3:m  H,(z)Fm(z))  j  t  j 


0.  VV/  6  2 . 


(2.19) 


or  using  L  =  k^nm  -  kmbmtgmi 


(- 


{ m  r^mi  ^rr»  (  )£/f  t 


0. 


(2.20) 


It  is  shown  in  Appendix  A  that  ( pb/m  -  r6m(  +  dk„,b,„i)  can  take  any  integer  value  </.  under  tlie 
conditions  0  <  p  <  fci  -  1,  0  <  r  <  A.m  -  1.  and  d  ^  Z.  Then 


:a9l-Ht(:)F, 


f>i ...  <ii , 


=  o  Vue  z. 


This  is  equivalent  to 


{Ht(z)Fm(z))l 


rjj 


k,bu 


=  o  v«  e 


Since  this  holds  for  all  integers  a,  we  can  rewrite  it  as 


(2.21  ) 


2.22) 


Hl(z)F,ll(z))  lg(i  =0. 


Let  now  5,(2)  and  Qk(~)  come  from  the  same  branch,  i.e.  /  =  in.  Then  (2.15)  means 


Hm(z)Fm(:)) 


=  Hp-r). 


(2. 2d! 


(2.21 


that  is. 


Jl>-  r)  ^(Um{z)Fm[z)) 


Hp  -  r>- 


•>  2,y 


Now  p-  t  can  reach  any  integer  in  [~km  +  \.km  •]•  so  that  the  last  equation  is  equivalent  to 


(//m(2)/m(2))[i>n 

1 1 


(2.26) 


Together  with  (2.23),  this  implies  biorthonormality  (2.(5). 


2.2.  Corollaries 

Corollary  1.  No  two  declinators  can  be  coprime. 

If  any  two  n,' s  are  relatively  prime,  then  their  gcd  is  1  and  we  cannot  satisfy  the  conditions 
for  PR  with  rational  filters.  This  is  because  (2.(5)  now  implies  ///(;)/•',„(;)  =  0  for  /  f  w  and  this 
cannot  be  satisfied  with  rational  filters. 

Corollary  2.  Completeness. 

Definition  2.1.  A  set  of  vectors  {x,}^o  ‘n  an  infinte-dimensional  Hilbert  space  is  said  to  be  complete 
if  the  zero  vector  is  the  only  vector  orthogonal  to  all  of  x,‘s  (pp.  6.  [1C»] ). 

Assuming  that  the  filter  bank  has  the  perfect  reconstruction  property,  the  completeness  of  the 
filter  bank  follows  immediately.  To  see  this,  let  us  write  (1.3)  [with  t(t>)  -  *(»,)]  in  a  different  way 

A/-1 

X  (n)=  y'  (i(  —  m),  h"(  m  +  nik))f,(n  -  n,k).  (2.27) 

i  =  0  k 

Assume  there  is  a  nonzero  input  x(n)  such  that  ,r (-«)  is  orthogonal  to  all  the  analysis  filters  and 
their  n^-shifted  versions.  Then  the  above  sum  would  be  zero  and  the  system  would  not  lie  a  PR 
system.  Similar  conclusion  can  be  made  for  the  synthesis  filters  if  we  interchange  the  analysis  and 
synthesis  filters  (because  PR  is  not  violated  by  such  an  interchange). 

Corollary  3.  Linear  independence. 

Definition  2.2.  A  set  of  vectors  Tj,k{n)  =  {/,(«  -  n , k ) ) ,'io  1  •  k  6  Z  in  an  infinte-dimensional  space 
is  said  to  be  linearly  independent  (or  minimal)  if  none  of  t/j/y(»)"s  lie  in  the  closure  of  the  linear 
span  of  {r/im(tt)}(^o  *  m  ^  ^  for  I  =  J  (see  pp.  28.  [Hi]). 

Since  the  synthesis  filters  form  a  biorthonorma.1  system,  it  can  be  proved  [1(5]  that  the  set 
of  sequences  7j,*.(n)  is  linearly  independent.  We  will  often  say  ‘'filters  /•',(-)  and  I^i')  are  lit) 
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early  independent1',  meaning  that  the  corresponding  time  sequences  and  their  shifts  are  linearly 
independent  in  the  above  sense.  Using  c-domain  techniques,  we  have  another  useful  manifes¬ 
tation  of  linear  independence.  Let  A,U)  be  rational  functions,  then  tin*  linear  independence  of 

{ F0(z ),Fi(z), .  • i(- )}  implies 
M-\ 

A,{zn')Ft{z)  =  0  =>  A,(  =  )  =  0  for  /  =  0.1 . \1  -  1.  (2.28) 

i=0 

To  see  this,  just  take  inverse  ^-transform  of  (2.28).  The  result  is 

At  —  1  oc 

y  y  <i,(k)fi{»  -  Am,)={0}. 

i=0  fc=  —  oo 

where  {0}  denotes  the  zero  sequence.  Taking  inner  product  of  both  sides  with  h,(n  -  u,k)  for 
i  —  1,2 . V/  -  1  and  V  A:  €  2,  we  get  (2.28). 

Corollary  4.  Basis  property. 

In  a  Hilbert  space,  completeness  and  independence  of  a  set  of  vectors  is  not  sufficient  to 

conclude  that  these  vectors  form  a  basis*.  However,  by  using  the  further  assumption  that  the 

synthesis  and  analysis  filters  are  stable  (i.e.  £„[/», (n)|  <  oc  and  ]TI(|/,(n)l  <  tx  or  /•,(<■■'“'). 

exist  and  are  upper  bounded  by  a  finite  constant  ),  we  show  that  {/,(»  -  mtq 1  and 

{h,(n  —  1  V  m  6  2  are  bases  for  /2  space.  For  this,  we  will  invoke  Theorem  9.  pp.  32. 

[16].  Since  completeness  and  existence  of  a  complete  biorthonormal  sequence  have  been  established 

earlier,  it  is  sufficient,  according  to  the  above  theorem,  to  show 
At  - 1  m  - 1 

^  ^  |  <  r(n),/*{mn,  -  n)  >  |2  <C  oc  and  ^  ^  |  <  .r(  n  )./?*(  nm,  -  n)  >  j~  <  x. 
1=0  m  i=0  m 

(2.29) 

for  any  x{n)  €  l2-  In  this  discussion,  all  summations  with  unindicated  limits  are  from  -oc  to  -x. 
We  will  show  that 

M  - 1 

1  <  -  ”)  >  I2  <  C'ik(”)lij.  (2.30) 

1=0  m 

t  In  this  paper,  the  term  ‘basis'  stands  for  the  Riesz  or  unconditional  basis,  as  defined  in  [16] 
pp.  31.  or  [17]  pp.  71.  Other  kinds  of  bases,  the  Schauder  and  Hamel  bases  [16]  do  not  concern  ns 
here. 
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for  any  sequence  i(n)  €  1 2  •  Thus 

M- 1  A/-1 

EE  I  <  xin )•  fi(mnt  -  n)  >  |2  =  EEIE  i(v)f,(rn7t,  -  11 ) 


i=0  m 


i=0  m  n 
M  —  1 


(2.31) 


j=0  m 


where  Zi(n)  is  the  rc,-fola  decimation  of  the  convolution  x(n)  *  /,(n).  Using  Parseval's  relation  the 
above  can  be  rewritten  as 


M  —  1  00  M—  I  ,  ,li r 

E  E  I  <  ar(n),/*(m.n,  -  ti)  >  p  -  £  ’ 

i=0  m=-  00  «=0  20 


•M-l  1  f  2w 

^Es  1 

i=0  •'u 


-V(c^)/,fc^)|VL 


■2.32) 


A/  — 1 


<  !(*(«)![?  E  su{>  ^ 
l=0  -€[0.2*1 


as  long  as  x(n)  e  h- 

The  first  inequality  follows  because  the  energy  of  a  decimated  sequence  is  no  greater  than 
that  of  the  undecimated  version.  The  proof  for  the  analysis  filters  is  similar.  So.  we  really  have  a 
biorthonormal  basis  formed  by  the  set  of  w, -shifted  versions  of  the  synthesis  and  analysis  filters. 


Corollary  5.  Unit  energy  implies  orthonormaiity! 

Consider  the  maximally  decimated  system  [Fig.  1(a)].  Suppose  the  following  two  properties 
are  satisfied: 

1.  Perfect  reconstruction  property,  and 

2.  All  analysis  and  synthesis  filters  have  unit  energy,  i.e.,  ]C„|Mn)|2  =  £„l/i(”)P  =  1,  for 
0  <  t  <  M  —  1. 

Then  the  synthesis  filters  satisfy  orthonormality.  In  olher  words,  eqn.  (2.7)  holds.  (This  does 
not,  of  course,  imply  that  a  biorthonormal  system  can  be  orthonormalized  simply  by  scaling  the 
filters  to  have  unit  energy.)  To  prove  this,  note  that  the  perfect  reconstruction  property  implies 
biorthnormality  (Theorem  2.1.),  so  that,  in  particular, 

E^(n)/,(-w)  =  1-  (2.33) 
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Now,  Cauchy-Schwarz  inequality  says 


n  n  n 


(2.3)1 


The  right  hand  side  is  unity,  by  (2.33).  The  left  hand  side  is  also  unity  if  the  analysis  and  synthesis 
filters  have  unit  energy.  But  equality  in  Cauchy-Schwarz  inequality  implies  h,(n )  =  < jH'  /,*  ( -  » )  for 
some  6{.  Substituting  in  (2.5)  we  readily  conclude  that  6,  -  0  and  that  the  set  of  synthesis  filters 
(equivalently,  the  set  of  analysis  filters)  satisfies  orthonormaLity. 


Corollary  6.  Generalization  of  Nyquist  and  power  complementary  properties. 

For  uniform  filter  banks  (n,  —  M  for  all  i)  it  is  well-known  that  if  the  system  is  orthonormal 
(paraunitary),  the  filters  Hi(z)  and  Fi(z)  are  spectral  factors  of  Nyquist  (A/)  filters  (or  A/th  band 
filters)  [10,  page  297].  In  the  more  general  (nonuniform,  and  biorthonormal  case),  this  property  is 
replaced  with  the  property  that  Hi(z)Fi(z)  is  a  Nvquistf  n, )  filter.  We  can  readily  see  this  from  the 
biorthonormality  condition  (2.6)  by  setting  i  =  / 

[Hi(z)F,(:))[n  =  1.  (2.35) 

Next,  for  the  uniform  paraunitary  filter  bank,  it  is  well  known  that  the  atiavsis  filters  are  power 
complementary,  and  so  are  the  synthesis  filters  [10,  p.  296].  For  the  general  case  (nonuniform, 
biorthonormal)  we  have 

Y-H,(z)Fi(z)=\,  (2.36) 

1 — '  Tli 

I 

(see  [15])  which  reduces  to  the  power  complementary  property 

£#.(2)//,^)  =  M  (2.37) 


in  the  uniform  paraunitary  case. 


3.  ORTHONORMALIZATION  OF  BIORTHONORMAL  FILTER  BANKS 


From  the  second  section,  we  know  that  if  the  integers  { » \  IcLo*  art>  such  that  ^  *s  possible, 
the  analysis  and  synthesis  filters  (and  their  shifted  versions)  form  a  biorthonormal  basis.  I'nder  this 
condition,  does  there  exist  a  PR  system  with  orthonormal  filters?  The  answer  to  this  question  is  in 
the  affirmative;  we  will  present  an  orthonormaLization  process  which  preserves  the  filter  hank-like 
form  of  the  system  {h,(v  -  mn,  ),/i(n  -  Ami)}  for  0  <  j,  /  <  M  -  1  and  m.k  €  2.  If  one  wants  just 
to  orthonormalize  some  set  of  vectors,  the  Gram-Schmidt  technique  is  one  way  of  doing  this,  but 
we  want  more,  namely  lo  preserve  the  filter  bank-like  form  of  the  system.  We  now  show  how  to 
achieve  this  aim.  Our  procedure  is  reminiscent  of  the  Gram-Schmidt  technique,  but  it  converges  in 
a  finite  number  of  steps  even  though  the  space  has  infinite  dimension. 

3.1.  Normalization  condition  or  Nyquist  condition 

Let  Fk(z)  be  a  rational  transfer  function.  Define 


Gk(z)  =  ak(z'")Fk(z). 

Then  Gk(z)Gk{z)  =  ak{znk  )ofc(zn*  )Fk(z)Fk(z).  so  that 


(3.1) 


^Q/t(zn*  iSfcU"*  )Fk(z)Fk(z)j  =  ojfc( ~)ofc(  ~ )  (VfcU)f\-( 


(3.2) 


Now  if  we  choose  (xk{z)  such  that 


&k{z)<*k{z)  = 


K-'M  1.. 


(3.3) 


we  get 


(Gk(z)Gk(z))  |  =  1. 


(3,1) 


A  function  Gk(z)  with  this  property  will  be  called  normalized.  This  is  different  from  the  usual 
meaning  of  normalization  of  vectors  in  f2-  1°  the  time  domain,  'he  above  normalization  condition 


If. 


means  that  the  n^-shifted  versions  of  yk(n)  (i.e.,  |<7*(n  -  in fc)})  form  an  orthonormal  »et .  Kquiva- 
lently,  Gk(z)0’k(z)  is  a  Nyquistf  n*.)  filter  (JO.  p.  151];  that  is  its  impulse  response  coefficients  fi{u) 
satisfy  h{nki)  —  0  for  i  ^  0. 

The  existence  of  ~ )  satisying  (3.3)  is  assured  because  of  the  following.  We  have 

nk  -i 

(Fkl=)hl*))  =—T  (3.5) 

V  '  in*  n*  t 

Since  Fk(z)Fk{z)  >  0  on  the  unit  circle,  each  term  in  the  above  expression  remains  nonnegative. 
Thus  whenever  Fk(z)  is  rational,  the  function  ^Tj.(r)Ffc(r)j  j  is  rational  and  nonnegative  on  the 


unit  circle.  Such  functions  can  always  be  written  as  a  product  a(z)u(z).  The  spectral  factor  «(;)  (a 
rational  function,  not  unique)  can  be  obtained  by  standard  spectral  factorization  techniques.  Now 


take  afc(i)  =  1  /a(z)  so  that 


Ofc(2)Ofc(5) 


a(z)Mz)  (Fk(z)Fk(  =  )) 

\  /  'l  m, 


and  (3.3)  is  satisfied.  The  function  a(z)  can  be  chosen  to  have  no  poles  outside  the  unit  circle  (by 
choosing  a(z)  to  have  minimum  phase),  but  what  if  u(z)  has  a  zero  on  the  unit  circle?  Then  o *. ( - ) 
will  have  a  pole  on  the  unit  circle!  This  potential  instability  will  be  handled  later  on. 

If  two  filters  F,{z)  and  Fk{z)  are  orthogonal,  will  that  property  be  preserved  by  ihe  above 
operation?  Let  G,(z)  and  Gk(z)  be  the  normalized  versions  of  F,(z )  and  Fk(z).  Then 

( 'Gi(z)Gk(z ))  =  o.(z"‘'**  )«fc(  z’"f9.k )  (FAz)h(z))  =  o  (3.7) 


showing  that  orthogonality  is  preserved  (notice  that  nk/;)ik  and  n,/g,k  are  integers).  Summarizing, 
if  we  have  a  set  of  orthogonal  filters  'hen  the  above  normalization  can  be  used  to  obtain 

a  set  of  orthonorma/  filters  {G,(z)}f.lQ  1 . 


3.2.  Orthogonalization 

Let  {Fk(z)}%L~0l  be  the  set  of  rational  synthesis  t  ransfer  functions  for  a  maximally  decimated 
PR.  filter  bank  with  decimation  ratios  { «*- } c -7 ' •  now  describe  a  procedure  to  get  a  new  set  of 


rational  transfer  functions  {G k{z)}^L0l  which  are  mutually  orthogonal,  i.e.  satisfy 


(g*(2)G,(*)) 


0  for  k.  I  =  0, 1, . . . ,  M  -  1  and  k  l. 


(3.8) 


9  k  l 


We  start  by  making  Go(z)  =  Fo(z)  and  Gi(z)  orthogonal  to  Go(z).  For  this,  let  us  look  for  G’i(z) 
of  the  form 

Gi(2)  =  Fx{z)  -  J0i(~901  )G0(z).  (3.9) 


We  want 


or,  using  (3.9) 


(  Gi  (2  )Go(  2 )  J  =  0  (orthonormality), 
''  ' 


(3.10) 


(3.11) 


(3.12) 


(Fi(2)G0(z))  -l3o,{z)(Go(z)Go(2))  =  0. 

t  '  J'goi  '  ' 

This  can  be  satisfied  if  we  choose  /3oi(z)  as 

doi(z)  =  Uoi  _ 

(Gq(^  )Go(-))  Jgoi 

Clearly  Po\(z)  is  a  rational  transfer  function.  Then.  G\(z)  as  in  (3.9)  remains  a  rational  transfer 
function.  This  is  how  we  start  this  orthogonalization  process.  Now  assume  that  we  have  made 
Go(z), G](z), . .  .  ,G*_i(z)  orthogonal  to  each  other  in  the  sense  of  (3.8).  In  the  sth  step  we  want 
to  make  GB(z)  orthogonal  to  Go(z),Gi(z), . .  .,6Ts_i(z).  Assume  Gs(z)  in  the  form 


s-l 


Ga(z)  =  Ft(z)~'lTt3is(z9-i)GAz). 


«=o 


Let 


L  —  ffsO^-sO  —  —  1  c»,t  —  1  • 


(3.13) 


(3.14) 


After  expanding  /?js(z)  into  cSj-fold  polyphase  components  we  get 

c.i-l 


p„(z9“  )  -  y 


(3.15) 


1=0 


so  G«(z)  is  of  the  form 


Gb(z)  =  Fb(z)  -  Y  £  3IB,(zL)z-l9"Gt(z) 
1=0  1=0 


(3.16) 
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We  want  to  make  Gs(c)  orthogonal  to  Cjt(  — )  for  k  =  0,  1 . s  -  1.  In  other  words  we  want 


(<?.(*)&(*))  {  =  (Fs(a)G'fc(^))  -EE  ^)Si(-L)z-l^a,(=)ak(~))[  =o.  (3.i7) 


i=0  1-0 


It  is  easily  verified  that  a  rational  function  A(.:)  satisfies  (.4(c))  |  g=  0  if  and  only  if  ( cmM(  '))[L_cg 
=  0  for  m  =  0, 1, . .  .,c  —  1.  Then,  (3.17)  can  be  written  as 

S—l  C, {  —  1 

»=o  1=0 

for  m  =  G,  1  ,...,cstc  ~  1  and  k  —  0,1,. ..,5  —  1.  So  we  have  J^|S=o  c«>  unknowns  'f,.,/(c).  and  the 
same  number  of  linear  equations.  If  the  determinant  of  the  system  (which  is  a  rational  function 
of  z)  is  not  identically  zero,  we  can  solve  the  system  of  linear  equations  for  d,st(z)’s.  If  this  is  not 
the  case,  we  can  keep  decreasing  the  number  of  unknowns  until  we  have  a  determinant  that  is  not 
identically  zero  (see  Appendix  C).  After  solving  it,  we  see  that  A.,(c)‘s  are  rational  functions,  so 
G.(?)  wdl  remain  a  rational  transfer  function.  At  the  end  of  this  process,  we  have  a  new  set  of 
rational  transfer  functions  (G/tU)}^1  satisfying  (3.8). 


=  (zma'k  F.{:)Gk{z)) 


(3.18) 


3.3.  Stability 

In  this  subsection  we  show  that  if  the  transfer  functions  resulting  from  the  orthonormalization 
have  poles  outside  the  unit  circle,  they  can  be  moved  inside,  preserving  the  orthonormal  and  PR 
property.  We  also  show  that  in  the  process  of  orthogonalization  and  normalization  described  in 
Sec.  3.2.  and  3.1.,  the  poles  will  automatically  be  excluded  from  being  on  the  unit  circle. 

First  assume  that  after  the  orthonormalization  we  got  with  some  poles  outside 

the  unit  circle.  For  example,  let  Zq  be  a  pole  outside  the  unit  circle.  Construct  the  FIR  filter 

nk  -1 

l[(l-^za\Kk)  (3.19) 

1=0 

(Recall  W/y  —  e-J2w/tv  as  usual).  This  has  zeros  at 

zoW„k,  0<l<nk-l.  (3.20) 
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Simplifying  (3.19)  we  obtain  the  form  {1  —  z  n*  z^k ).  Define  the  product 

Qk(zn> )  =  ( 1  -  )(1  -  z?  ) . . .  (3.21 ) 

where  •  •  •  are  the  poles  of  G'k(z)  outside  the  unit  circle,  arid  construct  the  allpass  function 

7k(zn‘)=  QJ{--n^.  (3.22) 

Qklznk) 

This  has  all  poles  inside  the  unit  circle.  Now  form  a  new  set  of  functions  as 

<?*(*)  =  7fc(2n‘)Gife(*).  (3.23) 

Then  Gk(z )  has  no  poles  outside  the  unit  circle.  The  new  set  satisfies  orthogonality  because,  for 
m  ^  k, 

(Gk(z)Gm(z))  =  (lk(z”k  Y?k{zfim{zn-  )G'm(r)) 

=  n(znk/9im)lnl{znm/9km)(G'k(z)G'm(z))  I  =0.  (3-24) 

V  '  J'9im 

' - - - - 

=0 

(Recall  that  nk/gkm  and  nm/gkm  are  integers.)  Normality  is  preserved  too  since 

(Gk[z)Gk(z))  =  ik{zffk(z)  |nk  =  1.  (3.25) 

=i  =i 

So,  we  have  shown  how  to  replace  the  poles  outside  the  unit  circle  with  poles  inside,  without 
destroying  orthonormality. 

Avoiding  poles  on  the  unit  circle. 

Let  us  repeat  (3.13)  below,  but  call  it  Ps(z)  for  notational  convenience. 

S~  1 

P.(z)  =  F.(z)  -  £  &.(**"•  )<?*(*)•  (3.26) 

i=0 

This  function,  in  general,  can  have  both  poles  and  zeros  on  the  unit  circle.  First,  assume  that  it 
has  a  pole  of  order  r  at  zp  =  eJW'\  It  will  be  shown  that  this  will  be  cancelled  in  the  process  of 
normalization.  Recall  that  the  normalized  function  G,{z )  is  constructed  according  to 

G.(*)  =  «.(*"•  JP.U),  (3.27) 
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where 


OjU)5,(2)  = 


(3.2H  > 


It  is  shown  in  Appendix  B  that  if  P»(z)  has  a  pole  of  order  r  on  the  unit  rirrle,  then  os(r"' )  defined 
as  per  (3.28)  will  have  a  zero  of  order  at  least  r  at  the  same  point.  This  zero  will  cancel  out  the 
pole  of  Ps(z ),  so  that  the  normalized  Csf-J)  will  not  have  any  pole  at  that  point.  We  see  that  G\{z) 
cannot  have  any  pole  on  the  unit  circle  coming  from  Ps{z)- 

The  other  possibility  is  that  as(2n* )  itself  has  a  pole  on  the  unit  circle,  i.e..  (  Ps{:)Ps(z)) 

\  /In, 

has  a  zero  on  the  unit  circle.  Assume  that  a,(zn> )  has  a  pole  of  order  r  at  z o  =  and  hence  at 
zqW^  ,  0  <  k  <  n„  -  1.  We  have 


<!.(*"•  )5(z"*)  = 


([px{z)Ps(z)) 


(3.29) 


From  this  equation  we  conclude  that  as(2n*)  can  have  a  pole  of  order  r  at  some  point,  on  the 
unit  circle,  if  and  only  if  j  {  has  a  zero  of  order  2r  at  that  point.  For  this 

to  happen  F,(z)  must  have  zeros  of  order  at  least  r  at  z  =  for  A-  =  0. 1 . ns  -  1  (for  the 

proof  see  appendix  B).  These  zeros  will  cancel  with  the  above  mentioned  poles  of  a.,(-n?)  when 
Gg(^)  is  formed.  From  this  we  can  conclude  that  G's(^)  cannot  have  any  poles  on  the  unit  circle. 
Together  with  the  fact  that  poles  outside  the  unit  circle  can  be  moved  inside,  we  conclude  that  the 
described  procedure  leads  to  stable  filters. 


3.4.  Numerical  Examples 

Example  3.1.  Uniform  system.  As  an  example  of  the  above  described  procedure,  we  orthonor- 
malized  an  uniform,  four-channt’  filter  bank.  The  filters  that  we  started  with  were  all  FIR,  linear- 
phase,  obtained  from  a  two-level  tree  of  two-channel  filter  banks.  Each  filter  in  the  two-channel 
module  has  length  10  ([18j).  The  resulting  orthonormal  filters  are  IIR.  and  their  numerator  degrees 
are  28,44,140,380  and  denominator  degrees  25,41,77,377  respectively.  We  see  that  the  orders 
of  the  filters  increase  rapidly  as  we  proceed  with  the  orthonormalization  process.  The  magnitude 
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responses  [see  Fig.  3(a)  and  3(b)]  are  more  or  less  the  same  before  and  after  orthonormalization. 
Most  of  the  polynomial  coefficients  after  orthonormalization  are  very  small  and  can  be  discarded 
without  harming  the  frequency  response,  but  it  deteriorates  the  orthonormality  property. 

Example  3-2.  Nonuniform  system.  We  orthonormalized  a  three-channel  filter  bank  with  deci¬ 
mation  ratios  4,4  and  2.  The  filters  that  we  started  with  were  all  FIR  with  lengths  2K.28  and  10. 
After  the  orthonormalization,  we  got  IIR  filters  with  numerator  degrees  100,  28.  10  and  denomina¬ 
tor  degrees  33,25,9  respectively.  Again  their  magnitude  responses  [shown  in  Fig.  4(a)  and  4(b)] 
do  not  differ  much. 

The  examples  show  that,  while  the  above  procedure  is  of  theoretical  interest,  the  resulting 
filters  are  far  from  being  efficient.  The  main  aim  of  the  section  is  to  emphasize  the  existence 
of  orthonormal  systems  for  nonuniform  filter  banks  where  biorthonormal  systems  exist,  and  then 
demonstrate  the  orthonormalization  technique. 

3.5.  Numerical  Considerations 

In  actually  implementing  the  orthogonalization  algorithm,  one  fares  the  problem  of  decimating 
IIR  trasfer  functions  [(3.6),  (3.12),  etc.].  Theoretically,  we  could  expand  the  rational  transfer 
function  into  partial  fractions,  then  expand  each  of  them  into  a  power  series  in  and  retain  every 

term.  This  does  not  yield  numerically  accurate  results.  There  are  several  ways  to  avoid  the 
factorization  of  polynomials. 

The  first  one  is  based  on  a  state-space  manifestation  of  the  decimation.  Namely,  if  A  is  a  state 
transition  matrix  in  some  realization  of  H(z),  then  An’  is  a  transition  matrix  of  the  decimated 
system  H{z)  lni .  Now  in  order  to  get  the  denominator  of  the  decimated  system,  we  need  to  find  the 
characteristic  polynomial  of  An> .  We  see  that  this  already  may  be  a  rather  big  numerical  problem, 
especially  if  the  order  of  the  system  is  big. 

Another  method,  again  system  theoretical,  relies  on  the  fact  that  a  rational  transfer  function 
(with  no  common  factors  in  the  numerator  and  denominator)  of  order  A'  ran  be  determined  from 
the  first  2N  +  1  impulse  response  coefficients  (it  can  be  shown  that  the  determinant  of  the  system 
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is  nonsingular  [19]).  The  impulse  response  coefficients  of  the  decimated  system  can  he  obtained 
from  the  impulse  response  of  the  original  system,  which  can  he  easily  obtained  from  the  difference 
equation  described  by  that  transfer  function.  The  problem  with  this  approach  is  that  the  matrix 
of  the  system  of  linear  equations,  even  though  nonsingular,  is  typically  ill-conditioned. 

The  third  method  is  based  on  the  frequency  manifestation  of  the  decimation.  Namely,  we 
know  that 


'  '  A=0 


( ;}.:?()! 


Now  if  we  write  H(:)  as  a  ratio  H{:)  -  X  (:)/ D{:).  the  denominator  of  the  decimated  system  can 
be  written  as 

it.  - 1 

Dd u'i  =  n,  n  (3.31 i 


k=a 


So  in  order  to  get  the  denominator  of  the  decimated  system,  we  have  to  find  FFTs  of  t  he  modulated 
denominators  of  the  original  system  D[:\Vk).  multiply  them,  stretch  »,  times  (i.e.  decimate  by 
n ,  )  and  multiply  by  n,.  The  inverse  FFT  of  the  result  will  give  us  1)^ fr).  Notice  that  here  we  have 
a  product  of  polynomials,  which  is  appropriately  implemented  using  the  FFT.  The  critical  factor 
is  the  number  of  terms  in  the  product.  It  depends  on  »,  only,  not  on  the  order  of  the  filter. 

After  we  get  the  denominator,  getting  the  numerator  is  easy.  We  can  again  use  FFT  techniques. 
Calculate  the  sampled  DFT  of  H(:\Yk). 


H(f^'  IF*) 


(3.32) 


where  w'/'s  are  the  sampling  frequencies  (frequencies  at  which  DF  l  is  the  sampled  Fourier  transform 
of  the  numerator  and  denominator).  We  add  all  of  these,  divide  by  and  stretch  ?t,  times,  to  get 
the  sampled  DFT  of  //(_)  ln,=  //<*(•:).  Since  we  already  know  the  DFl  of  the  denominator  of  this 
sampled  frequency  response,  we  can  get  the  DFT  of  the  numerator.  The  product  of  this  sampled 
DFT  and  the  DFT  of  Ddi  =  )  will  give  us 


(3.33) 
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After  doing  the  inverse  I) FT  of  this  sequence,  we  get.  the  numerator  polynomial  /J,e ').  One  has  to 
pay  attention  to  the  number  of  points  of  FFT  (sampling  density  of  DFT).  to  avoid  aliasing  in  the 
frequency. 

The  third  method  yielded  much  better  results  than  the  second  one.  especially  for  high  order 
filters  and  large  decimation  ratios.  This  method  was  actually  used  for  producing  ail  the  above 
examples. 


4.  COMPLETE  DECORRELATION  OF  THE  SUBBAND  SIGNALS 
4.1.  Decorrelation  with  Orthonormal  Filters 


4.1. a  Uniform  Case 

In  the  traditional  transform  coding,  where  the  polyphase  matrices  of  the  corresponding  uniform 
filter  bank  are  just  constant  unitary  matrices  (Kl.T  for  example),  the  subband  signals  x,{n)  are 
decorrelated  for  the  same  time  instant.  That  is.  D{xt{n, x*(m)}  -  0  whenever  ?  ^  j  and  m  — 
n.  In  the  other  extreme  case  where  the  filters  are  ideal  brick  wall  filters  (the  polyphase  matrix 
having  infinite  order)  the  subband  signals  are  completely  uncorrelated,  that  is  K{ x,{  n  ).r*(  rn )}  =  0 
whenever  i  f-  j,  for  any  choice  of  n.m. 

In  this  section  we  will  consider  the  problem  of  complete  decorrelation  by  use  of  rational  (finite 
order)  filters.  We  will  show  that  the  subband  signals  cannot  be  decorrelated  in  this  way.  if  we 
use  rational  paraunitary  filter  banks  (unless  the  input  signal  has  severely  restricted  statistical 
properties:  see  below). 

Consider  an  uniform  system  (vk  —  M  for  all  k).  Let  the  filter  bank  input  x(n)  be  WSS  with 
power  spectrum  STr(c).  assumed  to  he  a  rational  function  of  c. 

Definition  J.I.  For  any  scalar  input  signal  x(n)  we  can  form  a  vector  signal 


x(r?) 


/  x(n.lf)  \ 
(  T(n.\f-1)  ) 


\x(n!M  -  M  -f  1)/ 


(4.3) 


This  vector  signal  is  the  output  of  the  delay  chain  in  Fig.  ‘2(b)  after  decimation,  and  is  called  ihe 


M-fold  blocked  version  of  t he  input  signal  s(n).  It  is  known  [20]  that  the  power  spectral  matrix  oi 
this  sector  VYSS  process  is  pseudocirculant.  Namely 


[  ~“1Nxx,a/-](~)  Nxx.0(c)  SXI.u-,{;)  \ 


\  :'lSrxA(z)  •••  Nxx,)(:i  I 

wdtere  5xxp(2)  is  the  ith  polyphase  component  of  the  autocorrelation  function  .Sxx(c).  After  passing 
x(n)  through  the  analysis  bank  polyphase  matrix  E(c).  the  output  signal  yi/i)  has  power  spectrum 


Syy(  _)  =  Etc  )Sxx(c)E{c). 


(4. a . 


If  we  want  the  subbatid  signals  to  be  decorrelated,  then  Syy(z)  has  to  be  a  diagonal  matrix. 
Furthermore,  if  we  use  orthonormal  systems,  the  polyphase  matrix  has  to  be  unitary  on  the  unit 
circle.  Thus,  on  the  unit  circle.  (4.3}  can  be  regarded  as  a  unitary  diagonalization  of  the  Hermit ian 


matrix  Sxx(e^).  IN ov  we  recall  that  a  pseudocirculant  matrix  can  be  written  as  [21] 


v07 


V  -V/ 


(4.4  1 


where 

T(r)=  diag(l.r“,/A/,r””>/A/ . c-^).  (-1.5  i 

W  is  the  DFT  matrix,  and  D  is  a  diagonal  matrix.  Since  the  matrix  i-s  unitary  on  the  unit 

circle,  it  follows  that  the  diagonal  matrix  Syy( e-'~ )  is  identical  to  the  diagonal  matrix  f  )  up 
to  rearrangement  of  the  diagonal  elements.  Ignoring  this  rearrangement,  we  get 


Sy  y(r'-')  =  ,V/D(^“'). 


(  4  .0  ) 


Now  assume  that  Sxx(e-,'“')  is  rational,  and  that  we  wish  to  diagonalize  it  with  the  rational  parau¬ 
nitary  matrix  E(eJ~).  From  (4.0)  we  see  that  D(r^“-')  has  to  be  rational.  Now  Fq.  (4.4)  implies 

"/D(:)W*  =r-‘(r)SxxU)r(r).  (4.7) 


By  multiplying  out  the  left  hand  side,  and  using  the  pseudocirculant  property  of  Sxxf  :)  we  conclude 
that  the  rationality  of  Sxx(c)  and  D(z)  implies  that  Sxx(z)  has  the  form  (  ’U)I.  That  is.  it  is  a 


diagonal  matrix  with  identical  diagonal  elements.  This  means  that  the  power  spectrum  of  the  input 
process  x(n)  has  the  form  Srr(')  =  C{:S1).  In  other  words,  the  autocorrelation  R{  k)  ~  0  unless  k 
is  a  multiple  of  M. 

4.1. b  Nonuniform  case 

The  subband  signals  can  be  expressed  as 

ii(rc)  -  Y.  x(n,n  -  and  x}(ti)  =  y ^  xjvjii  -  k)hj{k).  (4.K) 

m  Jfc 

Then  the  crosscorrelation  between  these  two  sequences  is 

rij(nj)  =  E{Xi{n)x'j(n  -  /)}  =  ^ hi(m)h’(k)E{x(n,n  -  ni)x'(n}(n  -  /)  -  /,•)}.  (1.9) 

*;  m 

Let  the  autocorrelation  of  the  input  signal  x.(n)  (assumed  WSS)  be  r(k).  Then 

r,j{n,  I)  =  ^  ^  hi(m)h’j(k)r((  n,  -  r>j)r<  +  n}l  +  k  -  m).  (4.10  ) 

k  m 

We  see  that  rlJ(n,l)  depends  on  n  if  rt,  ^  rij,  so  that  x,(n)  and  Jij(n)  are  not  jointly  WSS  even 
though  they  are  WSS  themselves.  Because  of  this  we  cannot  apply  lho  above  argument  to  this 
problem. 

4.2.  Biorthogonal  Decorrelation 

Having  shown  that  an  orthonormal  filtei  bank  cannot,  in  general  be  used  for  decorrelation,  we 
will  decorrelate  the  subband  signals  using  a  biorthonormal  filter  bank.  Assume  again  that  r{n)  is 
WSS.  For  the  uniform  case  (n*  =  M  for  all  i)  we  obtain  from  (4.10) 

r,j{l)  -  Tij{nJ)  =  /?,(?» )/;J(F)r(Af/  +  k  -  m). 

k  m 

The  subband  signals  are  decorrelated  if  this  is  zero  for  i  ^  j.  Equivalently,  in  the  r  domain, 

■c>,j{z)  =  ^Hj{z)II,{z)S(z)j  |^=0  for  i  4-  j.  (4.11) 

whore  StJ{z)  is  the  r-transfonn  of  rSJ(l). 
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Given  a  PR  ( birot honormal)  system  with  analysis  filters  H,(z).  we  show  how  to  obtain  a  new 
set  of  analysis  filters  such  that  the  above  holds.  For  this  we  apply  techniques  similar  to  the  ones 
in  Section  3.  The  new  analysis  filters  will  be  G,(c).  Synthesis  filters  will  be  obtained  by  invertinu 
the  polyphase  matrix  (possibly  unstable).  Let  Go(~)  =  //o ( - ) -  In  order  to  make  -ri(w  >  arid  s0\ tn 
decorrelated.  we  look  for  G\{~)  in  the  form  G'i(i)  =  H\{z)  -  )Go(~).  We  want 


(^G\(z)Go{z)S(z)Sj 


M 


=  0. 


(4.12i 


For  this,  we  choose 


(hx(z)G0(z)S(z)) 

3m(:)  =  S - LAk 


(4.1 3 


At 


^6'o(2)G'o(  ~  )5(  r  i'j 

If  H0(z)  and  H\(z)  are  linearly  independent  (in  the  sense  described  in  Sec.  2.2.1.  it  can  be  readily 
verified  that  Got*)  and  Gj(z)  are  also  linearly  independent.  If  we  continue  this  process,  in  the 
step  we  have: 

*-i 

G$(z)  =  H,(z)  -  ^  -if; si  z*1  )G*(  ')•  (4.14  ! 


We  do  not  want  xs(n)  to  be  correlated  to  any  of  .r,(«)  for  i  <  s.  For  this,  wo  need 


9  —  1 

(Gk(z)Gt(z)S(z))  j  w  =  (ffs(c)G,lz)S(z))  |  for 

fc= 0 


/  =  0. 1 . .<-1.  (4.15) 


We  have  3  linear  equations  and  that  many  unknowns.  This  system  has  determinant  that  is  not 
zero  identically  (see  appendix  C  for  the  proof  in  the  case  of  orthogonalization ).  Otherwise  there 
exist  ak(z),  such  that 

9-1 


£<!*(*)  (G*U)G,(*)$(r))j  =  0  for  /  =  0.1. 

fc=o  1 

Now  if  we  multiply  by  ai(z)  and  add  all  these  equations,  we  get^ 


1. 


(4.1(11 


u=o 


\l  =  o 


=  0. 


(1.17) 


M 


^  While  it  is  not  obvious,  it  can  be  shown,  using  the  theory  of  Smith-forms  [19].  [22],  that  <?*(;:) 
are  polynomials  whenever  Gk(z)  and  S(z)  are  rational. 
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Since  S(z)  is  a  nonnegative  function  on  the  unit  circle,  we  can  conclude  [see  the  explanation  of 
(0.3)] 

*- 1 

Y,*k(=M)Gk{z)  =  Q.  (4.18) 

h-Cl 

This  means  that  Gk{z)  for  k  =  0,1 _ ,s-  1  are  linearly  dependent  (2.28).  It  can  be  shown  that 

this  is  not  possible  if  Hi(z)'s  are  linearly  independent.  So  the  determinant,  of  the  system  (4.15)  is 
not  identically  equal  to  zero.  After  the  system  is  solved,  we  have  new  analysis  filters  G,(~) "s  which 
decorrelate  subband  signals.  The  corresponding  synthesis  filters  can  be  obtained  by  inverting  the 
analysis  bank  polyphase  matrix  (stability  cannot  be  guaranteed,  not  even  for  the  analysis  filters). 

As  an  example  of  the  above  decorrelation  procedure,  we  take  a  Iowpass  AR((i)  process  [14]  and 
a  paraunitary  two-channel  filter  bank  [23]  with  FIR  filters  of  order  7  (filter  8A).  Fig.  5(a)  and  5.(b) 
show  the  frequency  responses  of  the  original  and  modified  analysis  filters  that  decorrelate  subband 
signals.  The  resulting  analysis  filters  are  FIR  of  order  7  and  18.  The  synthesis  filters  are  1IR  of 
orders  18  and  12.  To  see  whether  this  decorrelation  improves  the  performance  of  the  system,  we 
calculated  the  coding  gain  of  the  system,  t  Since  the  coding  gain  depends  on  the  frequency  response 
magnitudes,  stability  of  the  filters  does  not  enter  into  our  calculations.  The  original  coding  gain 
with  the  paraunitary  system  was  Gpc  =  3.09.  After  decorrelation  it  is  Gqc  -  '2.8.  This  indicates 
that  decorrelation  of  the  subband  signals  itself  does  not  necessarily  increase  the  coding  gain.  On 
the  other  hand,  the  coding  gain  of  the  ideal  brick  wall  two-channel  filter  bank  is  G$pc  ~  3.38  and 
subband  signals  are  fully  uncorrelated. 

The  filters  that  decorrelate  the  subband  signals  depend  heavily  on  the  filters  that  we  start 
with  and  the  coding  gain  we  can  achieve  with  them.  The  filter  banks  that  decorrelate  the  subband 
signals  are  not  paraunitary,  so  there  is  nothing  to  ensure  that  the  coding  gain  will  be  greater  than 
one  [24]. 

5.  THE  COMPATIBILITY  CONDITION,  AND  GENERALIZATIONS 


f  See  [14]  or  [24]  for  the  definitions  of  coding  gains. 


We  now  present  a  different  type  of  necessary  conditions  for  perfect  reconstructability  in  noiiuniforni 
filter  banks.  These  can  sometimes  be  used  to  quickly  reject  certain  sets  of  integer  decimation  ratios 
{?i,}  from  being  considered  for  perfect  reconstruction.  In  all  our  discussions  we  assume  maximal 
decimation,  that  is  l/n«  =  1-  Th*1  discussions  of  this  section  do  not  apply  to  the  case  of  the 

so-called  block  decimation  [3j. 

5.1.  Compatibility 

In  Fig.  1(a),  the  reconstruct'd  signal  A’(~)  is  given  by 

M  —  l  .  n*  —  I 

X(z)=  Y  Fk(=)—  Y  HkWZWW'Z )•  (5.1) 

fc=0  n=0 

In  order  for  each  of  the  alias  terms  A’( 'IV,^ ),  v  0  to  be  cancelled,  it  is  necessary  that  for  every  A 
and  n  there  exist  l  /  k  and  m  such  that  M7"  =  If™.  This  requirement  is  called  the  compatibility 
condition  and  is  a  necessary  condition  for  alias  cancellation  (see  [1]  and  page  285  of  [10])-  If  the 
set  of  integers  {n,}  satisfies  this,  we  say  that  it  is  a  compatible  set. 

For  example,  the  set  {2.3,(i}  is  not  compatible  because  the  quantity  .V ( -  VI V> )  cannot  be  paired 
with  any  of  the  terms  A(zfT/ )  or  A' ( ).  On  the  other  hand  the  set  {2. 0,0.0}  is  compat  ible:  those 
decimation  ratios  come  from  a  tree  structure,  whose  first  level  has  decimators  (2.2)  and  second 
level  splits  the  bottom  branch  using  three  filters  and  decimators  (3,3.3).  And  any  set.  of  decimators 
that  come  from  a  tree  is  compatible,  because  we  know  we  can  design  the  tree  structure  to  be  alias 
free.  The  converse  is  not  true,  i.e.,  not  every  PR  system  can  be  drawn  as  a  tree  structure.  We  saw 
this  in  Sec.  1.,  where  a  counterexample  was  presented  to  demonstrate  this  point.. 

Test  for  compatibility. 

Assume  that  the  integers  n,  are  numbered  such  that 

n0  <  ni  <  ...  <  in,-] .  (5.2) 

The  shifted  versions  of  the  input  which  appear  in  ,Y(~)  are 

A' (  ).  \<n<vk-\.  ( 5.3 ) 
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The  compatibility  condition  is  equivalent  to  the  following  statement:  for  every  pair  of  integers 


( n,Ji ),  1  <  <  n,  -  1.  (5.-1 ) 

there  must  exist  a  pair  of  integers 

(^TTi'^m)'  1  S  ( rn  S  1  (O..)) 

with  m  ^  i,  such  that  W**  =  W*™.  First  consider  m a/ — i •  which  is  the  largest.  Clearly  lFrJ1M 
cannot  be  equal  to  Wjf.  for  any  n,  <  So  it  is  necessary  that 


2  =  l- 


(5.(>  l 


This  also  ensures  that  all  the  powers  of  W„M_l  have  been  paired. 

Now  consider  some  smaller  n,.  Suppose  this  is  a  factor  of  that  is  n,\r-i  =  n,p,.  Then 

Wn.  =  W™, _t  and 


So  all  the  powers  of  Wni  have  been  paired.  That,  means  that  we  need  not  worry  about  the  set  of 
integers  which  are  factors  of  njv/.]. 

Next  let  nm  be  some  integer  which  is  not  a  factor  of  .  Suppose  U'(’m  rai1  he  paired  with 
t  for  some  J  <  .  Then 


2nJ 


'2  IT 


—  '2nn 


(o.S) 


nM  —  l  m 

for  some  integer  n.  That  is,  — — - =  n.  But  since  0  <  J  <  n,vj-i ,  this  is  possible  only  for  n  =  0. 

Thus  violating  the  assumption  that  n,„  is  not  a  factor  of  «lf. j.  Thus  llrL  * 

for  any  J  in  1  <  J  <  It  cannot  therefore  be  equal  to  a  power  of  U  n.  for  any  tj ,  which  is  a 

factor  of  (because  the  powers  of  Wn>  form  a  subset  of  powers  of  H  „M_,  ). 

Summarizing,  we  can  partition  the  set  of  decimators  {n,}  into  two  classes. 


Set  1:  Those  that  are  factors  of  tim-i- 
Set  2:  Those  that,  are  not  factors  of  nyvj_ j. 


.‘10 


For  each  n,  in  Set  1.  has  been  paired  with  a  power  of  .  And  none  of  the  ufs  in  Set 

2  can  be  paired  with  any  member  of  Set  1.  Thus,  the  original  set  of  decimators  {n,}  is  compatible 
if  and  only  if  Set  2  itself  passes  the  compatibility  test. 

Statement  of  the  test.  Summarizing  the  above,  we  can  test  for  compatibility  as  follows. 
Step  1.  Check  if  n\f-i  —  njvf-i.  If  no,  then  {m}  is  not  compatible.  If  yes,  continue. 

Step  2.  Form  the  smaller  set  by  collecting  those  n,  that  are  not  factors  of  n,v-i-  Then  imagine 
that  this  is  the  given  set.  and  repeat  the  test,  i.e..  go  to  Step  1. 

At  some  point,  if  the  answer  is  no  in  Step  1,  then  the  original  set  is  not  compatible.  If  we  keep 
getting  yes  in  Step  1,  then  after  a  finite  number  of  repetitions,  the  "smaller  set“  in  Step  2  becomes 
empty.  The  original  set  {nj  is  then  compatible.  Thus,  the  test  always  gives  a  decision  in  a  finite 
number  of  steps. 

To  demonstrate  the  test,  consider  the  set  (2,6. 10. 12. 12.30.30).  We  have  =  riM-i  =  30 
so  that  Step  1  is  successful.  The  smaller  set  of  numbers  that  are  not  factors  of  30  is  given  by 
(12, 12).  This  set  again  passes  Step  1  successfully.  The  next  smaller  set  is  empty.  Thus  the  test  has 
been  completed,  and  the  given  set  (2,6.10,12.12.30.30)  is  indeed  compatible.  It  turns  out  that 
this  set  of  integers  cannot  come  from  a  tree  structure  (binary  or  otherwise).  For,  if  it  did.  then  the 
first  level  of  the  tree  would  have  to  be  a  two  channel  system  with  decimators  (2.2).  The  second  level 
then  splits  the  lower  branch  of  the  first  level  only,  with  the  decimators  (3.5.6.6.15. 15).  Since  3 
and  5  do  not  have  common  factors,  this  set  of  numbers  could  not  have  come  from  a  tree-structured 
connection  of  uniform  filter  banks. 

It  turns  out  that  while  the  above  set  is  compatible,  it  is  still  not  consistent  with  another 
necessary  condition  for  alias  cancellation  (hence  PH).  This  statement  will  be  elaborated  at  the  end 
of  the  next  subsection. 

5.2.  Generalizations 

We  can  obtain  further  necessary  conditions  by  looking  deeper  into  the  details  of  alias  cancella¬ 
tion.  Thus  consider  the  PH  condtiou.  expressed  in  terms  of  the  /.-channel  equivalent  uniform  filter 
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bank  (where  L  is  the  1cm  of  tij's;  Sec.  1.2.),  it  takes  the  form 


So(*)  $i(*) 

S0(zWL)  S^zWL) 

C-f  \  C.(rWW 


Sl-i(z) 

i't-if-W’tj 


Qai?) 
Q  i(s) 


VSoUWf1)  Sx(zWj;-')  ■■■  SL-i(zHl)/  \Ql- .(-)/  VO/ 

By  substituting  for  the  L  pairs  of  filters  {S*(z),C2fc(~)}  in  terms  of  the  original  A/  pairs  filters 
{/f/t(Ar),  Ffc(^)}  using  (2.9),  we  can  rewrite  this  in  the  form 


HLU)f(*)=  . 


where  f (z)  =  [  F0(z)  . . .  FM-i  ]T  and  Hijc)  is  an  L  x  M  matrix.  The  ith  column  of  this  matrix 

has  the  form 

{kMz)  0  ktH,(zWn. )  0  k,H,{zWfu )  ...  0  k,H,(~W^)  of  .  (5.11) 

where  0  is  a  string  of  A:,- 1  zeros.  (Recall  that  A-,  are  integers  such  that  Ar.nj  =  L).  The  compatibility 
condition  says  that  any  nonzero  row  of  Hr(r)  should  have  at  least  two  nonzero  entries. 

Now  notice  that  the  decimation  ratios  rco.ni _ bm-j  of  the  M  channel  nonuniform  filter 

bank  may  not  all  be  distinct.  Let  us  relabel  them  in  terms  of  distinict  integers,  for  convenience  of 
discussion.  Thus  let  the  decimators  be 


n0 .  Bj) ,  .  .  .  7t0 ,  Ti  i ,  Tl  | ,  .  .  .  71] ,  ...  Tl  ft  .  11  ft  _)....  77  ft  _  j , 


No  times  A-!  times 


a ji  _  i  times 


In  this  notation,  n,  are  distinct  integers  and  A’o  +  A’i  +  . . .  Nk-i  —  M- 

For  example,  let  us  fully  understand  the  0th  column  of  the  matrix  H/,(r).  If  A’o  =  2.  then  there 
are  two  columns  (zeroth  and  first)  of  the  form  (5.11).  with  the  same  decimation  ratio  »0  (and  the 
same  A:0).  More  generally,  there  are  .V0  columns  of  the  form  (5.11)  with  the  same  »o  and  the  same 
A*o-  These  Ar0  columns  have  nonzero  entries  occuring  in  the  same  positions,  namely  ()"',  kJ0h ,  2A-(/> 
and  so  forth.  Consider  now  another  column,  say  the  one  corresponding  to  This  has  nonzero 
elements  occuring  at  the  locations  0,  kt.  2k ,,  and  so  forth.  Now  compare  this  with  the  0th  column. 
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and  identify  the  locations  where  nonzero  elements  overlap.  With  the  exception  of  the  O''1  location, 
the  first  overlap  of  nonzero  elements  will  occur  at  the  location  lcm(fco,^i).  Define 


mo 


inin^o  km  {ko,kt) 
ko 


(5.13) 


Then  the  nonzero  elements  of  the  leftmost  column  in  the  k ^  2 ktf1,  . . .  ( m0  -  1  jkff  positions  do  not 
overlap  with  any  nonzero  elements  from  any  other  columns,  except  of  course,  columns  1.2... .  A0. 
We  can  isolate  these  nonzero  elements  in  the  first  A'o  columns  of  equation  (5.10),  and  write 
H0(zWno)  Hi(zWno] 


Ho(zW*o)  Hx(zWlo, 

L  Ho(zW™°~1 )  Hi(z\V”l°~l ) 


Hs0-i(zWno) 

Hs^zW*) 


HSQ-X(z\v?rl)\ 


r  /;o(-)  I 

t\(=) 

■  F)\0 — i  ( ~ ) . 

0. 


(5.11) 


A  necessary  condition.  We  will  now  prove  that,  if  the  number  of  rows  m o  -  1  >  number  of 
columns  No ,  then  perfect  reconstruction  is  not  possible!  So  the  condition 


m,j  -  1  <  Nj,  0  <  j  <  I\  -  l  (5.15) 

is  necessary  for  perfect  reconstruction,  where  N}  is  the  number  of  decimators  equal  to  n  j .  and 

'(m  {k‘-k'K  (5.16) 

kj 

This  is  a  generalization  of  the  compatibility  condition  which  merely  said  that  any  nonzero  row  of 
H  L(z)  should  have  at  least  two  nonzero  entries. 

Proof  of  the  necessary  condition.  Eqn.  (5.11)  implies  that  the  columns  of  the  matrix  are 
linearly  dependent  [unless  all  the  Fi(z)' s  in  that  equation  are  zero,  which  is  not  possible  in  a 
maximally  decimated  perfect  reconstruction  system).  If  nio  -  1  >  A0.  this  means  that  the  rotes  are 
linearly  dependent.  Denoting  the  first  row  of  the  matrix  in  (5.14)  as  h(clT„n).  the  remaining  rows 


Since  this  holds  for  all  z,  we  can  replace  z  with  zW~l  to  obtain 


mo— 2  m o~2 

h(z)=  «.+i(^"01)h{zH'r'{0)  =  ]T  i3j(z)h(zH'^o).  (5.18) 

i=i  1=1 

But  eqn.  (5.14)  says  that  h(zVF‘o)g(z)  =  0  for  1  <  ?  <  m0  -  1.  Using  this  in  (5.18)  we  conclude 
h(z)g(z)  =  0.  That  is, 


Ho(z)Fq(z)  -f  H\(z)F\{z)  +  . . .  +  ///v0_i(z )F;v0-i (z)  =  0.  (5.19) 

But  this  cannot  happen  in  a  maximally  decimated  perfect  reconstruction  system.  To  see  this  note 
that  the  biorthonormality  condition  (2.6)  implies,  in  particular. 


( 


H0(z)F0(z)  +  H\{z)F\(z)  4-  ...  +  H rv0 _ i (z ) F\0 _ i ( z ) 


=  A'c 


>*0 


(5.20) 


which  is  not  possible  if  (5.19)  is  true!  This  completes  the  proof  of  (5.15)  for  j  =  0.  The  same 
argument  can  be  used  to  show'  that  (5.15)  is  true  for  j  =  1.2,...,  K  -  1  as  well. 

This  test  is  strictly  stronger  than  the  test  for  compatibility.  To  demonstrate,  consider  the  same 
set  (2,6,10,12,12,30,30)  from  the  end  of  the  previous  subsection.  As  shown  there,  it  satisfies  the 
compatibility  condition.  According  to  the  notation  in  this  subsection.  n<! s  are  distinct  numbers 
and  we  have  K  =  5,  L  =  60  and 

i  0  12  3  4 

N,  2  2  1  1  1 

rii  30  12  10  6  2 

ki  2  5  6  10  30 

m,  3  2  1  1  1 

Since  mo  —  1  =  2  =  No,  we  conclude  that  PR  is  not  possible. 


6.  CONCLUSION 

For  a  maximally  decimated  nonuniform  filter  bank,  the  perfect  reconstruction  (PR)  property 
is  equivalent  to  biorthonormality.  Using  this  fact  we  derived  a  number  of  properties  of  PR  filter 
banks.  We  then  showed  that  whenever  the  decimation  ratios  are  such  that  biorthonormality  is 
possible,  it  is  in  particular  possible  to  obtain  orthonormality.  This  was  done  by  developing  an 


orthonormalization  procedure.  While  reminiscent  of  the  Gram-Schmidt  approach,  the  procedure 
converges  in  a  finite  number  of  steps  and  furthermore  preserves  the  filter  bank-like  form  of  the 
basis  functions.  We  then  modified  the  orthonormalization  procedure  for  the  application  of  subband 
decorrelation.  It  was  demonstrated  that  mere  decorrelation  of  subband  signals  does  not  necessarily 
optimize  the  coding  gain  of  a  system.  Finally  we  considered  the  problem  of  alias  cancellation,  and 
obtained  a  generalization  of  the  so-called  compatibility  condition  which  is  a  necessary  condition  for 
perfect  reconstruction  in  maximally  decimated  systems. 

APPENDIX  A.  REACHING  ARBITRARY  INTEGERS 

In  connection  with  equation  (2.20),  we  will  show  t  hat  the  quantity  pb/m  -  rbmi  +  dkmbmi  can  be 
made  to  take  any  integer  value  by  proper  choice  of  the  integer  d ,  and  the  integers  p.  r  in  the  ranges 
0  <  p  <  ki  —  1,  0  <  r  <  km  —  l.  For  this  recall  the  meanings  of  the  integers  brn{ ,  b(m .  and  /,.  namely, 
eqns.  (1.8),  and  (2.17).  Since  L  =  Aqrq  —  kmnm  by  definition,  we  have  kibimgtm  -  kmbmigim.  So 
kibtm  =  kmbmt.  Since  and  6mJ  are  relatively  prime  by  construction,  there  exist  integers  p  and 
f  such  that 

pbim  -  rbmi  =  any  desired  integer  a.  (.1.1) 

We  can  always  decompose  p  and  f  as  p  =  p  +  nkt  and  r  —  r  +  ikm%  where  0  <  p  <  ki  -  1.  and 
0  <  r  <  km  —  1.  Substituting  this  into  (A.l)  and  rearranging,  we  get 

pbim  ~b  dkmbmi  ~  u,  (.1.2) 

where  d  =  (n-  «).  Thus,  we  can  write  any  integer  a  as  above  where  p  and  r  are  in  the  stated  range, 
provided  we  can  assign  any  integer  value  to  d. 

APPENDIX  B.  POLES  ON  THE  UNIT  CIRCLE 

We  will  show  that  when  a  biorthonormal  filter  hank  is  orthonormalized.  the  resulting  filters 
will  naturally  be  free  from  poles  on  the  unit  circle.  We  will  do  this  in  two  parts. 

Observation  1. 
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Let  A(~)  be  a  rational  function  with  a  pole  on  the  unit  circle,  at  jq  =  f  3Jo  ■  Let  ru  be  the  order 
of  this  pole.  Then,  in  the  neighbourhood  of  20  >  the  function  A( >J“'  )A((  )  behaves  as 


A(ejw)A(e 


Ju>\ 


—  £  Jw o  )ru 


[BA 


This  is  the  behavior  of  a  pole  of  order  2 ra.  Since  A(*)A(z)  >  0  on  the  unit  circle,  we  have  ca  >  0. 
Nowf  let  B[z)  be  another  rational  function  with  a  possible  pole  at  the  same  point  c(),  with  order  rb. 
Then  B(e3U)B(eJU)  can  be  expressed  in  a  similar  way.  So 


A(eJW)A(eJU,)  +  B(ej*)B(e^) 


+ 


Cb 


(  f  —  (}u0  )ra  (f-J-  —  f  -J^O  )ro  (  ( 


rV-'o  ft (<■-}- 


f-J-J 0  )rt 

(B:>) 


Since  ca,Cb  >  0.  we  see  that  there  can  be  no  cancellations,  and  as  m  approaches  w(!.  the  result 
behaves  like  a  pole  of  order  =  max(2ra,2r<,).  Similarly,  if  we  have  a  sum  of  several  nonnegative 
functions  having  poles  of  various  orders  on  the  unit  circle,  the  sum  behaves  like  a  pole  of  order 
equal  to  the  largest  one. 

Consequence  of  observation  1.  Now  consider  the  normalization  step  (3.29).  The  denominator 
of  0,(0"*  )a8(zn* )  can  be  written  as 


(7 p,(z)p.iz))  )  t  =  -  jr 

\V  '  ±n,J  n,  Vs 


IB.  3) 


Each  term  on  the  righthand  side  is  nonnegative  on  the  unit  circle.  So  if  P3[z )  has  a  pole  of  order 
r  at  Jo  =  eJu;o  then  the  above  summation  still  has  this  pole,  with  order  >  2 r.  As  a  result.  ) 

has  a  zero  of  order  r.  This  means  that  w'hen  we  form  the  normalized  fd'^r  -  a 3{zn‘  )Ps{z). 

this  unit-circle  pole  will  be  completely  cancelled. 


Observation  2. 

From  (3.29)  we  see 

((F.MC,(z))  ]  J 


that  )  will  have  a  pole  of  order  r  at  20  =  eJ^°  if  and  only  if 

has  a  zero  of  order  2 r  at  2  =  20  =  Now  consider  (B.3).  Each  term 


in  this  sumation  is  nonnegative.  Suppose  the  function  P,( zW^  )  has  a  zero  of  order  r*  at  zq.  Then 


P,(e3u)W^  )P,(eJU)W*t )  =  (e3UJ  -  e3^0  )rk(e  -  e  JWa  )r*  x  (nonnegative  function)  (£?.4) 


on  the  unit  circle.  If  the  summation  in  (B.3)  has  the  factor  ( <J~  -  <J~- )'{ <  ~J~  -  <  )'  it  is 

therefore  necessary  that  rk  >  r  for  each  k.  That  is.  each  of  the  quantities  l )  has  to  have  a 

zero  of  order  >  r  at  c().  In  particular,  therefore.  P„(z)  has  a  zero  of  order  >  r  at 

The  conclusion  is  that,  if  o,(~n* )  has  a  pole  of  order  r  at  ;()  -  f J~'° .  tlien  /'„( z )  has  a  zero  of 
order  at  least  r  at  zo- 


APPENDIX  C.  ELIMINATING  REDUNDANT  VARIABLES 

If  the  system  of  equations  (3.18)  has  a  determinant  that  is  identically  zero,  we  can  reduce  tin- 
size  of  the  problem  as  follows.  In  this  case,  there  exists  amk(z).  with  at  least  one  of  them  different 
from  zero,  such  that 

i  - 1  c,k  -1 

Y  Y  {  =  0.  (C.l) 

t’  =  0  rn=0 

for  i  =  0,1,... .s  -  1  and  /  =  0.1 _ .cst  -  1.  While  it  is  not  obvious  that  there  are  polyno¬ 
mials  satisfying  (C.l),  this  can  be  verified  to  be  the  case,  by  use  of  the  Smith-McMillan 

decomposition  for  rational  functions  [19].  [22].  The  previous  equation  can  be  rewritten  as 


.1-1  C.fc  —  t 

s-‘*“G,(z)]r  Y  amk(=L)zmg’kCk(z) 

k~0  m— 0 


=  0 


for  all 


i  -  U.  1 . 
/  =  0.  1. 


1 


(C.2) 


After  multiplying  each  of  these  equations  by  «(,(')•  and  summing  them  with  respect  to  !  and  t.  we 

get 


,i-t 


'  4  —  0 


1-1 


Y  ^z9“ Y  ]G'( : 


1=0 


=  0. 


(C.3) 


where  Ai(z)  =  )■  Now.  for  any  rational  P(z).  the  equation  ( /'( =  0 

implies  F(z)  =  0.  This  is  because  F(eJ“,)P(eJU>)  >  0  on  the  unit  circle,  and  the  decimated  version 
cannot  otherwise  be  identically  zero.  So  (C.l)  implies 

a  —  1 


5>(*-)c;i(.-)  =  o. 


(C.l) 


i=0 

There  is  at  least  one  am,(z)  ^  0,  say  ajk(z)  ^  0.  Then  (C.l)  implies 

i-i 


Cfc(. 


•1 


<ijk(z 


c,o 


(C.5) 


i  =  0  "<  =  ° 

m  5 ij.  for  »  =  * 
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From  here  we  see  that  the  form  (3.16)  of  G,(:)  is  redundant  and  we  can  just  drop  the  term 
&k*j(sL)2~J9‘kGk{2)  and  form  a  smaller  linear  system  like  (3.17).  We  can  keep  doing  this  till  the 
determinant  is  not  identically  zero. 
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LIST  OF  FIGURES 


Fig.  1.  (a)  A  nonuniform  filter  bank  and  (b)  an  equivalent  uniform  bank. 

Fig.  2.  (a)  An  uniform  filter  bank  and  (b)  its  polyphase  decomposition. 

Fig.  3.  Example  3.1.  Magnitude  responses  of  analysis  filters,  (a)  before  orthonorrnalization.  { b )  afte 
orthonormalization. 

Fig.  4.  Example  3.2.  Magnitude  responses  of  analysis  filters,  (a)  before  ortlionormalization.  (b)  afte 
orthonormalization. 

Fig.  5.  Magnitude  responses  of  analysis  filters,  (a)  before  decorrelation,  (b)  after  decorrelation. 
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Fig.  1.  (a)  A  nonuniform  filter  bank  and  (b)  an  equivalent  uniform  bank. 
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Fig  5.  Magnitude  responses  of  analysis  filters, 
(a)  before  decorrelation,  (b)  after  decorrelation. 


